Papers by Jesse C. Cresswell
Classifying and Addressing the Diversity of Errors in Retrieval-Augmented Generation Systems (2026.eacl-long)
Copied to clipboard
Kin Kwan Leung, Mouloud Belbahri, Yi Sui, Alex Labach, Xueying Zhang, Stephen Anthony Rose, Jesse C. Cresswell
| Challenge: | Existing work on RAG errors has not accounted for the complexity of real-world RAG systems and their failure modes. |
| Approach: | They propose a taxonomy of error types that can occur in realistic RAG systems and an auto-evaluation method that can be used to track errors during development. |
| Outcome: | The proposed method can be used in practice to track and address errors during development. |
MSc-SQL: Multi-Sample Critiquing Small Language Models For Text-To-SQL Translation (2025.naacl-long)
Copied to clipboard
Satya Krishna Gorti, Ilan Gofman, Zhaoyan Liu, Jiapeng Wu, Noël Vouitsis, Guangwei Yu, Jesse C. Cresswell, Rasa Hosseinzadeh
| Challenge: | Recent advances in text-to-SQL generation rely on large closed-source models that present challenges in accessibility, privacy, and latency. |
| Approach: | They propose to use open-source text-to-SQL models to critique SQL queries . their method evaluates multiple outputs simultaneously and is competitive with larger models . |
| Outcome: | The proposed method achieves state-of-the-art performance compared to open-source models while remaining competitive with larger models at a much lower cost. |